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Introduction 

Study abroad Is an expensive, resource intensive activity for both students 
and their home institution. With an estimated 200,000 American students 
studying abroad in 2006, and an annual growth rate of eight percent (Institute 
for International Education, 2006), program administrators and international 
scholars are increasingly being asked to document the learning outcomes asso- 
ciated with study aboard to validate the expenditure of funds and resources 
(Vande Berg. 2001). Accrediting bodies such as Accrediting bodies such as 
The Higher Learning Commission (2007) and die Association to Advance Col- 
legiate Schools of Business (2007) are also calling upon colleges and universi- 
ties to formally assess the extent to which they are preparing their students to 
live and work in an increasingly interdependent global community. 

While academic units often express a wide range <4 learning goals and objec- 
tives within die context of international study, the importance of intercultural 
development is recognized by virtually all institutions (Greenholtz, 2000, Ham- 
mer, Bennett and Wiseman, 2003). Broadly conceived, intercultural sensitivity 
helps people to live and work with people of diverse cultural backgrounds (Landis 
and Bhagat. 1996) and diis in turn contributes to building essential leadership 
skills necessary for operating effectively in an increasingly complex glcfcai envi- 
ronment (Earnest, 2003). Tensions created as a consequence of die global war on 
terror have also drawn attention to die strategic value and overall importance of 
developing essential intercultural skills (Lincoln Commission, 2005). 
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Literature Review 

Measuring Intercultural Development 

Many approaches to measuring intercultural competency have been pro- 
posed over the years. Kelley & Meyers’ (1995) Cross Cultural Adaptability 
Inventory (CCAI) has been widely used to assess an individual's effectiveness 
in intercultural interaction and communication. The Intercultural Adjustment 
Potential Scale (ICAPS) helps identify elements of* a study abtoad experience 
that contribute to intercultural adjustment (Savicki et. al., 2004). The Inter- 
national Education Survey (IES) has been used to assess how an international 
experience impacts personal and intellectual development (DcDee and Stew- 
art. 2003). Tlie Global Awareness Profile (GAP) assesses fixe degree to which a 
person can recognize and appreciate the size, complexity and diversity of inter- 
cultural experiences and thereby be able to form an integrated worldview (Cor- 
bitt, 1998). Use Beliefs, Events and Values inventory (BEV1) is based on die 
level of agreement with various belief-value statements and assesses a uumber 
of characteristics related to intercultural competency, eg., openness, tendency 
to stereotype, receptivity, etc. (Shealy, 2003). The BEVI instrument is in die 
final stages of trial validadon. The Intercultural Development Inventory (IDI) 
by Hammer and Bennett (2002) measures die respondents overall develop- 
ment of intercultural sensitivity based on an individual’s progression through 
six stages of cultural development. 

We chose to use Hammer 6c Bennett's Intercultural Development Inven- 
tory (2002) for four reasons. First, the IDI was designed specifically to measure 
intercultural development, which is the focus of this study. Second, the IDI is 
grounded in theory (Bennett 1986, 1993). Davis arul Finney (2006) argue that 
a solid theoretical base offers opportunities for furdicr testing and development 
and may allow researchers to generalize results even when non-probability 
samples are used; a common problem when assessing study abroad programs. 
Third, the IDI has been subjected to extensive psychometric testing (Hammer, 
Bennett, and Wiseman, 2003; Paige et. al., 2003). As noted by Davis and 
Finney (2006, pg., 328), “...if an instrument being used lias poor psychometric 
properties, die inferences made based on diose findings arc at best ambiguous.’* 
And finally, we chase the IDI for die current study because it is bodi a descrip- 
tive and normative tool, it helps explain why people tespood differently to dif- 
ferent cultural experiences. It is our loog-term desire to develop intervention 
strategies diat can be used to improve the overall quality of our institution's 
study abroad programs. Paige (2004) suggests that tlie IDI is useful for guid- 
ing die development of training modules and odier intervention strategies; all 
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with minimal participant resistance. Paige concludes that overall the IDI is an 
effective instrument to integrate into iniert ultural training programs. 

The IDI was developed and refined by Hammer and Bennett <2002) to 
measure an individuals stage of inierc ultural development using a model devel- 
oped by Bennett (1986, 1993). Bennett’s Developmental Model of Intercultural 
Sensitivity (DM1S) is based on research showing tliat people progress through 
distinct and predictable stages o f intercultural development as they experience 
cultural differences in progressively more complex ways (Hammer and Bennett, 
2002; Hammer et al., 2003; KLak and Martin, 2003). These stages range from 
denial and defense through integration. The IDI is consistent with Bliawuk and 
Bnslin's (1992) description of intercultural sensitivity as an individtuls reac- 
tion tt» people from ocher cultures develops and changes over time. 

The IDI measures an individual’s overall stage of development in addition 
ui providing various scales that approximate Bennett's stages of intercultural 
development. The first stages of development (Dcnial/Defense, Reversal, and 
Minimization) represent an ethnocentric perspective whereas die latter stages 
( Ac ceptance/ Adaptation and Encapsulated Marginality) represent the degree 
ui which a person lias developed an cthnorclativc perspective. For example, the 
underlying construct diat Hammer and Bennett label as "defense against dif- 
ferences" is properly understood to be a more-or-lcss rigid judgment diat one 
culture is superior to another. Defensive characteristics generally take the form 
of ”my culture (way of doing things) is superior to all others” or "if only other 
people in die world understood my culture, then they too would want to do 
things the way we do.” A related version of this trait, known as reversal, occurs 
when people come to judge odicr cultures as superior to their own. (For a full 
description of the IDI scales, sec www.intercultural.org/idi_dmis.php.) 

The Impact of Study Abroad Programs 

Wlule there have been increasing pressures to document the impact of study 
abroad programs, few studies have employed pre-post measures in an attempt 
to measure changes. Medina- LtSpcz- Portillo (2004), Engle and Engle (2004), 
and Paige, Cohen, and Shively (2004) have examined intercultural sensitivity 
in study abroad programs designed to improve language skills. Paige et al. 
(2004) fuund thit US students studying language in French and Spanish speak- 
ing countries improved overall intercultural sensitivity and Engle and Engle 
(2004) reported similar findings. Engle and Engle also observed due students 
involved in longer-term programs (full year versus one semester) showed the 
greatest gam in intercultural sensitivity. By contrast Medina-Lop£z-Poftillo 
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(2004) found litdc evidence for improvement as die result al a seven-week or 
semester-long program of study in Mexico. 

Short-term programs (one month or less) luve also been shown to 
have an impact on intercultural development. Anderson, Lawton, Rexeisen 
and Hubbard (2006) for example report a positive impact on intercultural 
sensitivity for a short-term (four-week) non-language-based study abrextd 
program. Patterson (2006) compared the effects of a short-term (two to four 
week) study abroad experience with that of on-campus intercultural study. 
Patterson found diat there was a small improvement in intercultural sensi- 
tivity for diose that studied abroad and no improvement for those with die 
traditional classroom experience. 

While additional studies employing a pre-post design are needed to evalu- 
ate the effect of study abroad programs, there is little research to show that 
study abroad lias a lasting impact after students return to their home cul- 
ture. A notable exception is a 2002 survey conducted by Use Institute for die 
Inter national Education of Students (IES, 2002), one of the largest known sur- 
veys of study abroad alumni. The survey resulted in more than 3,400 returned 
quest manures yielding an overall response rate of 23%. The students over- 
whelmingly reported that diey continued to develop their self-coniklencc and 
world-view after returning home as a result of dieir study abroad experience. 
An important limitation of the IES survey is diat its findings are bused on 
the alumni s subjective self-report. Tills current study will address diis short- 
coming by assessing whether or not improvement continues four months after 
returning from study abroad as measured by the IDI. 

The current study also assessed whether academic ability as measured by 
GPA scores or gender arc related to changes in intercultural development as 
the result of a study abroad experience. Rexeisen and Rofller (2003), for exam- 
ple, report that gender is related to changes in environmental atutudes as a 
result of a semester study abroad. They found diat the ecological worldview 
of women, as measured by the New Ecological Paradigm, tended to improve 
whereas mens attitudes tended to decline as a result of their study abreud 
experience. A review of study abroad programs reveals that GPA is a common 
screening criterion used for students studying abroad. Consequently, we evalu- 
ated whether dicre is a relationship between academic ability (os measured 
by cumulative GPA) and intercultural development. Given die propensity fur 
academic aptitude to be related to many different measures of student achieve- 
ment, this study predicts that cumulative GPA will be positively related to 
changes in intercultural development. 
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Research Hypotheses 

Van Hoot* and Verbeeter (2005) report that students believe study abroad 
enr itlies diem personally in ways that would not be possible studying at their 
home institution. This observation is consistent widi the personal experiences 
of Che researchers who collectively have led 17 study abroad programs over the 
past 12 years. The question Is whether it can be demonstrated empirically that 
study abroad programs improve interc ultural sensitivity. To address this ques- 
tion, the following hypotheses are tested in the current study. 

Pre-test vs. Post-test Hypotheses 

Hypodiesls la A semester long, faculty-led study abroad program will have a 
positive impact on tin? overall development of intcrcultural sensitivity as 
measured at die conclusion ol die semester pre-test to petit-test 
Hypodiesis 2a. There will be a reduction of denial and defense characteristics 
of participants from pre-test to past -test. 

Hypodiesis Ja: There will be a reduction of reversal tendencies or the pro- 
pensity to see odicr cultures as superior to ones own from pre-test to 
post-test. 

Hypodiesis 4a; Tlicrc will be a reduction in the degree of minimization of 
cultural differences from pre-test to post-test. 

Hypodiesis 5a; There will be an increase in the degree of acceptance of and 
adaptation to cultural differences from pre-test to post-test. 

Post-test vs. Follow-up Hypotheses 

Hypodiesis lb: Overall interculcural development will continue to improve 
after returning from die study abroad program (post-test to follow-up). 
Hypodiesis 2b. There will be a further reduction of denial and defense charac- 
teristics of participants from post-test to follow-up. 

Hypodiesis 3b: There will be a further reduction of reversal tendencies or die 
propensity to see other cultures as superior to ones own from post-test to 
fnllow-up. 

Hypodiesis 4b: There will be a furdier reduction in the degree of minimization 
of cultural differences from post -test to follow-up. 

Hypodiesis 5b: There will be a furdier increase in die degree of’ acceptance of 
and adaptation to cultural differences from post-test to fiillow-up. 
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Gender & GPA Comparisons 

Hypothesis 6: There will be gender difference* related to intercult urai 
development. 

Hypothesis 7. A student s academic aptitude (a* measured by cumulative GPA) 
will be positively related to intercultural development in both pre-test to 
peril-test and post -teat to follow-up. 

Methodology 

The Subjects 

The subjects in this research were traditional, college-aged students at a 
medium-sized, private Midwestern university in the United States. The under- 
graduate student body consists of less titan 10% international students or stu- 
dents of color. Tltc sample consisted of 54 junior-level students majoring in 
business participating in a semester-long study abroad program in London, 
England. Use average age was 21 years and 60% were women. Approximately 
half of die sample reported that they had traveled for less than 10 days out- 
side of the United State* prior to die current study abroad experience, 54% 
reported between 10 days and a month; and 17% indicated diat diey had trav- 
eled or lived for more than a month outside die US. The average GPA of the 
group was 3 5 widi a range of 3-0 to 3-9- Eighty-nine students applied for the 
London program and only 54 were selected. Students were selected based on 
GPA, student essays, letters of recommendation and personal interviews. 

The Study Abroad Program 

Tltc program was led by two faculty members from the Iiomc institution. 
Classroom instruction was conducted by the US faculty members as well as by 
British instructors. Classes met during the day, leaving evenings for the stu- 
dents to explore die local surroundings. In addition to their classroom duties, 
the US faculty served as academic advisors, counselors, and overseers of a ser- 
vice learning project in which die students participated as part of the study 
abriud program. For the service learning project, the students worked with a 
number of non-profit organizations in the British community. 

Wlule in London, the students' accommodations were widi British fami- 
lies. Student involvement with the families varied considerably but often 
included shared meals and conversations regarding British life. The program 
also included day trips to sites sudi as Oxford and Bath. In addition, die stu- 
dents traveled on weekends to various European locations providing additional 
opportunity to observe and experience interculturai differences. 


The Study 

The IDI was first administered at die beginning of the semester prior to 
departure bum the U.S. The setund administration of the IDI occurred at 
the end of the term but prior to returning to the U.S. A final administration 
occurred four mondis later, alter the students Iiad returned to the U.S. Col- 
lection of die data and analysis of results were conducted under supervision of 
faculty trained and certified by die Intercult ural Communication Institute. 

Results 

Forty -eight students out of 54 (89%) enrolled in the semester abroad 
program completed the pre-test IDI survey. Forty-six students completed the 
IDI at the end of the semester and 39 students (81%) of the original 48 stu- 
dents completed die pre-test, the post-test, and the final follow-up study four 
months after die end of die study abroad program. Tlie responses for these 39 
students were used to test the hypodicses in this study. 

Pre-test vs. Post-test Hypothesis Results 

As predicted, the students as a group exhibited a significant (p - .007) gam 
in tlieir Overall Development score by the end of their semester study abroad 
program providing strong support for Hypodicsis la (Table 1). The average 
score increased from 88.3 to 93-3- While significant progress was observed, 
the group mean for the students remained overall within the Minimization 
category range of 85-1 14 (Table l). 


Table 1. Paired One-tailed t-tests of Pre-test vs. Post -test Results 



Pro-test Results 

Post-test Results 


Hypothec 

Ave. 

Range 

S.D. 

Ave. 

Range 

S.D. 

P- 

value 

HI a - Ovetat 
De/etopmenl 

~5S.d 

56- 

126 

15.4 

63.3 

72- 

129 

15.6 

.067 

H2a - 

Defense' 

Denial 

4.12 

2.8- 

5.0 

.55 

4.06 

2.9- 

5.0 

.56 

.794 

H3a - 
Reversal 

3.50 

2.1- 

5.0 

.742 

3.71 

2.7- 

5.0 

.65 

.033 

H4a - 

Minimcabcn 

2.62 

1.8- 

4.0 

.63 

2.83 

1 

K <0 

.68 

.007 

Hfia- 

Acceptance.' 

Adaptation 

3.17 

1.8- 

4.5 

.66 

3.48 

2.4- 

4.5 

.53 

.001 
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In an effort to better understand the intercultur.il changes that occurred 
during the study abroad experience, we also assessed the changes in the com- 
posite scales that make up the overall IDI developmental score. Since none of 
the students in the study readied the Encapsulated Marginality stage (130+) 
in their Overall Development scure, we did not conduct a pre-post analysis 
fur this scale. 

Tabic I shows that there was no significant improvement in the students' 
score on the Defense/Denial scale. Although we hypothesized that we would 
find a reduction in the students' Defense .'Denial characteristics (Hypothesis 
2a) f die results were not surprising since most of the students had been fairly 
successful in resolving denial and defense issues prior to their study abroad (as 
reflected by the average score of* 4. 1 2 on a scale of 5. with a standard deviation 
of .55). 

As predicted there were significant improvements in the student scores 
on the Reversal. Minimization and Acceptance/Adaptation scales, supporting 
Hypodieses 3a, 4a, and 5a. These results show broad support for the students' 
intercultural development as a consequence of dicir study abroad. It should 
be noted however that post -test averages for diese scales (3.7 1 , 2.83, and 3 48 
respecuvely) show that die students still have not as a group fully resolved 
these issues. 

Post-test vs. Follow-up Hypothesis Results 

Table 2 shows die results for die analysis of die post -test versus follow- 
up hypotheses. The table shows that no significant change occurred on die 
students' Overall Development score. Tlie mean decreased from 93-8 to 92.0 
suggesdng that some of the gain in intercultural attitudes may have been lost 
once the student returns home. However, the magnitude of die cluuige did not 
reach statistical significance. 

No significant change was observed for either Defense/Denial ot Mini- 
mization after returning home and contrary to our expectations, change in 
the Reversal scale at follow-up showed a surprising decline to a level compa- 
rable to pre-departure (3. 50 vs. 3-71 vs. 3 57 respectively). The small drop 
previously noted in Overall Development at follow-up is due almost entirely 
to students' regressing on die Reversal scale. Only Acceptance/ Adaptation 
showed a significant improvement (p - .000) between the piost and follow- 
up assessment. As a consequence, hypotheses bib, h2b, h3b and h4b are not 
supported. Only h5b, ongoing improvement in Acceptance/ Adaptation was 
supported at follow-up. 
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Table 2. Paiml One-tailed t-tcsis of Post-test vs. Follow-up Results 



Post-test Results 

Foilow-up Results 


Hypothesis 

Ave. 

Range 

S.D. 

Ave. 

Range 

S.D. 

P" 

value 

Hlb- Overall 
Development 

§3.3 

72- 

129 

<5.9 

HTJT 

"58- 

130 

19.9 

.784“ 

H2b — 

Defense/ 

Denial 

4.06 

2.9- 

5.0 

.56 

4.04 

2.8- 

5.0 

.64 

.607 

H3B — 
Reversal 

3.71 

2.7- 

5.0 

.65 

3.57 

2.3- 

5.0 

.789 

.928 

H4t>- 

Minimization 

2.63 

1.7- 

4.3 

.68 

2.82 

1.8- 

4.3 

.76 

.610 

H5b - 

Acceptance/ 

Adaptation 

3.46 

2.4- 

4.5 

.53 

3.67 

2.9- 

4.5 

.46 

.000“ 


Pre-test vs. Follow-up Results 

Given die lack of significant improvement in the post -test versus follow-up 
results and die lower scores on die Reversal scale, and the small but statistically 
insignificant decline in Overall Development, die question arises as to the degree 
of students' overall improvement in intercultural development when measured 
from pre-departure to die four-month follow-up period. To answer tilts question a 
comparison of the pre-test scores and die follow-up scores (Table 3) was conducted. 
Results of this analysis reveal that only Minimization and Acceptance/Adapta- 
tion show a significant long-term improvement (p - .036 and .000 respectively). 
Although die overall development score shows improvement moving from 88.3- 
92.0, the titange is no longer significant. Tlierefore, this study raises questions 
about the long-term benefits erf study abroad on intercultural development. 


Table }. Paired One-tailed t-tests of Pre-test vs. Follow-up 


IDI scales 

Pre-test Resufts 

Fc*ow-up Resufts 



Ave. 

Range 

S.D. 

Ave. 


S.D. 

P- 

Development 

88.3 

58- 

126 

15.4 

92.0 

59- 

130 

19.9 

.076 

Defense/Denrai 

4.12 

2.8- 

5.0 

.55 

4.04 

2.8- 

5.0 

.64 

.609 

Reversal 

3.50 

2.1 - 
5.0 

.742 

3.57 

2.3- 

5.0 

.789 

.294 

■Rkmizaton 

2.62 

1.6- 

4.0 

.63 

"535 

1.8- 

4.3 

.76 

.030 

Acceptance/ 

Adaptation 

3.17 

1.6- 

4.5 

M 

3.67 

2.9- 

4.5 

.48 

uuu 
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TaU* 4: Test of Gander Differences at Specific Points in Time 




Pre- 

test 

Female 

vs 

Male 

Post- 

test 

Female 

vs 

Male 

Follow- 

up 

Female 

vs 

Mate 

Overall 

n 


P 


P 


P 

Ferrate 

25 

90.76 

0.206 

95.22 

0.311 

92.4 

0.587 

Male 

la 

63.92 


69.57 


”3572 


DD 








Female 

26 

4.26 

.0130T 

4.22 

.Q20T 

4.11 

0.264 

Male 

13 

3.80 


3.78 


3.67 


Reversal 

Ferrate 

25 

3.55 

0.766 

3.67 

0.603 

3.51 

0.732 

Male 

13 

3.47 


3.79 


3.6 


Minim 

Female 

25 

2.64 

0.702 

2.86 

0.581 

2.62 

0.743 

Male 

13 

2.56 


2.73 


2.74 


AA 

Ferrate 

25 

3.15 

0.453 

3.51 

0.582 

3.75 

0.121 

Male 

13 

3.31 


3.41 


3.49 



Note: Tests comparing Females against Males are independent 


samples. 2-ta4ed tests 
T results are significant at .05 or less. 

Gender Difference and Intercultural Development 

We also tested for gender difference including changes tlust may occur 
within a gender as measured at the pre, post, and follow-up periods. As shown 
in Table 4, females scored significantly better than die males on the Defense/ 
[Denial scale in both the pre and post -test time periods but die difference was 
dirninisliing over the course of die experience. The results foe changes in IDI 
scores (Table 5) ptovide additional evidence there may be gender differences in 
intercultural development. Even though women consistently scored higher on 
Overall Development, only men showed a significant improvement in Overall 
Development between die pre and post -test time period. It should be noted 
however that the differences between men and women diminished over time. 

A question might be also asked as to why only men improved on Overall 
Development when only women imptoved on the underlying IDI scales (Mini- 
miAitjun and Acccptance/Adaptation). How is this finding consistent with die 
general assumption that the IDI subscales are related to overall intercultural 
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Table 5* Test of Quotes within Gender Between Time Periods 




Pre- 

test 

Post- 

test 

Folio 

w-up 

Pre 

vs 

Post- 

test 

Post vs 
Fc*ow- 
up 

Pre vs 
Folio w- 

Overall 

n 

X 

"X 

X 

p 

P 

P 

Female 

25 

90.76 

95 22 

92.40 

.067- 

.909 

.312 

Male 

13 

83.92 

89.57 

88.72 

,008t 

.615 

.063’ 

"BB 








Female 

26 

4.26 

422 

4.11 

.663 

.947 

.895 

Male 

13 

3.80 

3.78 

3.87 

.580 

.095' 

.317 

Reversal 








Femaie 

25 

3.55 

3.67 

3.51 

.169 

.932 

.612 

Male 

13 

3.47 

3.79 

3.60 

.092- 

.856 

.302 

Minim 








Female 

26 

2.64 

2.86 

2.82 

,021t 

.678 

050t 

Male 

13 

2.56 

273 

2.74 

.130 

.479 

.201 

AA 








Female 

"25 

3.15 

351 

3.75 

.ooit 

.ooit 

000T 

Male 

13 

3.31 

3.41 

3.49 

.227 

.153 

.078’ 


hypothesis: Post score > Pre score 


development } Given that the change in women’s overall score is marginally 
significant it may simply be the case that sample si 2 C or related variance issues 
are contributing to this apparently inconsistent finding. Unfortunately sample 
sire limitations preclude further analysis of this question. Nevertheless, borh 
the pattern of differences and number of significant differences overall lends 
support for hypothesis 6. 

Educational Aptitude and Intercultural Development 

Assessment of the relationship between educational aptitude as measured 
by students’ cumulative GPA and dieir scores on die IDI is shown in Table 6. 
Only two of die 15 possible correlations were significant at p - .05 or better, 
and even in these two cases die correlations were very low. The pre-test score 
far die Reversal scale was significant with a correlation of -.37 1 indicating that 
a person with a higher GPA was prone to be oriented toward Reversal prior to 
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the study abroad experience, and die follow-up score for Acceptance/ Adapta- 
tion was significant with a correlation of’ .363 indicating that higher GPA’s 
tended to evidence higher levels of Acceptance/Adaptation at follow-up. Over- 
all there is very litdc support for Hypothesis 7. 


Table 6. Correlations Between GPA and IDI Scores 



Pre-test 

Post -test 

Fotow-up 

Overall Development 

-.174 

-.013 

-.059 

DefenseiDenial 

.097 

.215 

.106 

Reversal 

-.371 • 

-.101 

-.197 

Minimization 

.062 

-.209 

-.122 

• = Significant at p = .05 

.152 

.298 

.363’ 


Finally we tested for an association between the students' GPA and changes 
in their IDI scores between the pre-test and post -test and also between die 
post-test and die follow-up. We did dns to further examine whether dicre 
was a correlation between educational aptitude and improvement in the IDI 
scores. We did not find any significant correlations for any of these scales. This 
adds further support that there is litde relationship between the students' 
aptitude as measured by cumulative GPA and interculcural development. 

Discussion 

The results of diis study should both encourage and challenge diose who 
are interested in improving die quality of study abroad programs. Like ail areas 
of the academy, study abroad programs increasingly arc being held accountable 
for achieving measurable learning outcomes. The current study adds to die 
literature by documenting tfiat semester long, "island" programs can have a 
measurable, positive impact on the interculcural development of students and 
it addresses the question of whedier study-abroad yields long-term benefits. 

Our study provides strong suppoit for the proposiuon that study abreud 
experiences have a positive immediate impact on die interculcural develop- 
ment of students. Not only did the Overall Development score show signifi- 
cant improvement by die end of the study abroad program but three of die four 
scales of the IDI did as well. Only the Dcfense/Denial scale Lacked significance 
and on closer examination die average pre-test score for that scale (4.14) indi- 
cates diat the students mostly resolved these issues prior to departure. 

Of potential greater interest and concern is that this study raises ques- 
tions about die long-term effects of study abroad. Although the decline in the 
Overall Development score from die conclusion of the program to the time of 
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the fnllow-up study was not significant (moving from 93-3 - 92.0), if we ask 
the question, "Does cultural development improve from pre -departure to fol- 
low-up (88.3 - 92)?" the answer is inconclusive because the observed change 
is only marginally significant (p-.076). On further analysis it appears that the 
decline in the Overall Development score is largely due to students regress- 
ing on the Reversal scale. In other words, after returning home, many of the 
students came to view the country they studied in as culturally superior to 
their native culture. The rather large decline in the Reversal score from post 
to fullow-up (3.71 - 3. 50) was in a direction opposite from our expectations 
and was large enough to prevent our concluding (pee to follow-up) tlut study 
abnud has a long-term positive impact on intercultural development. Only 
Acceptance/ Adaptation improved during the post/follow-up period. However 
given that students also continue to evidence ethnocentric characteristics, the 
improvement in Acccptance/Adaptation must be interpreted with caution. As 
a consequence we want to encourage academic institutions to begin assessing 
how they can help their students to process their study abtoad experiences bet- 
ter after they return to their home institution. 

Figure 1 illustrates the percentage change, as opposed to absolute score, 
fur individual students on the Overall Development scale at the end of their 
study abroad experience (i.e., pre-test score / post -test score). It provides a 
visual depiction of die intercultural development gains made by the students 
over the duration of the program. With few exceptions, the students experi- 
enced gains in dieir Overall Development scores. 


Figure /. 



Unfortunately, we did nuc see tlie loped -fur improvement in overall intercul- 
tural development of students in the four rnontlis following tlie end of the study 
abroad experience. When comparing Figure l with Figure 2 you can set Isow 
some of tlie improvement in the Overall Development score tlut was recorded at 
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die end of die study abroad program (Figure 1) lus diminislied four months after 
returning home (Figure 2). Tliere were roughly as many students with decreases 
in die Overall Development scores as dicre were students with increases. 

Fit*n2. 



Finally, Figure 3 illustrates the Ovcril! Developmental score changes that 
occurred from just prior to the study abroad experience to four-months after 
returning home. Aldiough Figure 3 shows dial the majority of students (6996) 
had a small improvement in their Overall Development, the gam is no longer 
statisdcally significant (Table 3)- This raises the question of whit additional 
acuuftt can be taken to help students retain the significant gains in intercul- 
tural development tliat are observed at the end of the study abroad program. 


FiR"* i* 



We also examined live four primary scales upon which the overall IDI devel- 
opment score is based. We were pleased diat there was significant improve- 
ment in all of the scales (pre/post test) with the previously noted exception of 
Denial/Dcfense; and most students scored very highly on this characteristic 
prior to dieir study abroad experience. Use post -test/follow -up study however 
only showed further improvement in Accepcancc/Adapcacton. When viewed 
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liom the perspective of the long-term educational experience, (i.c., from pre- 
depan ure to follow-up) we axe unable to conclude chat study abroad resulted 
in a long-term significant overall inccrcultural improvement. 

Educators must therefore question whether their responsibility to dieir stu- 
dents ends when the term is over or whether they should be trying 10 develop a 
longer-term if not life-long learning partnership. Should one goal of study abroad 
programs be to facilitate intercultural development after students return home? If 
so, wliat more can we do to build and facilitate long-term positive learning from a 
study abroad exjjerience? Should study abreud students be required to take some 
form of “re-entry" course diat facilitates die ongoing integration of intercultural 
experiences? Would seminars or other interventions before study abroad help stu- 
dents to better process and understand their experiences abroad ? 

Finally, this study found very litde evidence chat GPA is related to how stu- 
dents develop interculcurally; ar least insolar as study abroad. We did identify 
a relationship between gender and intercultural development but we will allow 
the reader tu draw dieir own conclusion about the strength of die relationship. 
Hypothesis 6 was framed as a two-tailed test and given die number of potential 
differences chat can be identified within die IDI we have concluded that further 
research needs to be conducted before drawing any firm conclusions. 

Future Research and Limitations 

The current research involves students that participated in a semester long 
"island" program where the students traveled and largely studied as a group. 
This of course raises the question of whether immersion programs, where stu- 
dents are more fully integrated into the foreign environment, will have a dif- 
ferent impact on long-term intercultural development. There is also die ques- 
tion of whether programs of greater or shottcr duration will evidence a similar 
erosion of developmental benefits over time. Tlie length of time from die end 
of the program to follow-up is itself a limitation and future research may want 
to follow students over a longer period of time after their study abroad. 

This research is also based on a subject pool that studied in a country with 
a familiar language and a comparatively similar culture (US students studying 
in London). The students constitute a non-ptobcibilicy sample where students 
self-select into applying to this program. Moreover the program is highly com- 
petitive, there were 89 applicants tor 50 available positions. Students were 
admitted to the program based on interviews, letters of recommendation, per- 
sonal essays and dieir cumulative GPA scores. The latter criterion had the effect 
of restricting die range of GPA scores for die study. This raises the question of 
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the degree to which the results can be generalized to study abroad programs 
with open admission. 

The current study also did not examine specific outliers, those that either 
benefited tlie must or die least from the study abroad experience. Although it 
may be difficult to acquire a large enough sample of outliers to permit quan- 
titative analysis, there are a number of qualitative techniques that may enable 
us to develop greater insight into individual differences and to perhaps add to 
our knowledge base for fun her dieory development. 

Future research should also focus attention on the issue of confirming or 
disconfirming whether regression on the Reversal scale really does occur after 
students return to their home institution. Our concern is due students may 
tend to romanticize their study abroad experience to such an extent diat diey 
experience reversal and thereby impede dieir intercult ural development. 

The conclusions of this research are predicated on the unique characteris- 
tics of IDI instrument. While, as we noted earlier, it is grounded in theory and 
lias been subjected to considerable psychometric testing, it still lias some inher- 
ent characteristics that make assessment of hypotheses statements problematic. 
For example, while the Overall Development score is a continuous scale, the 
scales upon which it is built are independent and discontinuous. That is, a 
student docs not have to progress dirough a scale (e.g., Reversal) before enter- 
ing the following scales (i.e.. Minimization). These unique aspects inherent 
in die design of the IDI required some qualifications of our assessment of the 
results for each of the scales. Although we are confident in our selection of die 
IDI instrument, future research should be done employing other empirically 
validated measures of intercultural development. 

In general, study abroad is drought to improve intercultural awareness. Tlicrc 
is, however, mixed evidence of wliethet or nor changes in intcaultural sensitivity 
can be achieved through education and training due does not involve direct con- 
tact widi other cultures (Paige ( 1993). Pruegger and Rogers (1994), Bennett, Ben- 
nett and Allen (1999), Altschuler, Sussman, and Kachur (2003), Patterson (2006). 
More research is needed to compute and contrast experiential (study abroad) forms 
of learning widi less direct (e.g. f classroom) forms of education. Compiling and 
contrasting wtdun this context is menu to include examining how different edu- 
cational experiences might be used to support or complement each other. 

Finally it should be noted die lack of significant difference for GPA may be 
a result of the selective admission criteria used for admission to the program. 
The analysis of gend er differences in die current study is also limited by the 
relatively small sample of men that participated in the study (n- 12). 


6 


1 2 The InicfiiiM jplinixv jouciul of Study Aliicud 


Summary and Conclusion 

Overall this study supports that proposition that study abroad programs 
luve a positive start -term impact on intenulrural development- Tlie long-term 
impact of study abroad remains, however, in question. In the absence of contin- 
ued gains in die students' intercult ural development, and with some evidence 
that erosion on the Reversal scale may be occurring, we strongly encourage aca- 
demic programs give furdier thought to what additional resources (c.g., post 
study-abroad programming) might be developed to help students continue 
the constructive integration of their study abroad experiences. We also hope 
and strongly recommend diat additional research be undertaken to evaluate 
the long-term implications of study abroad in an effort to either corroborate or 
refute the findings of die current study. 
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